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Introduction 



During the past five years, we have had the pleasure of working with several companies that came to 
GBN seeking help in applying scenario analysis techniques to their research and development (R&D) 
plans over the medium- to long-term (generally five- to 10-year timeframes). These engagements 
involved companies in a range of industries — computer hardware and software, telecommunications, 
power generation — as well as people in varied roles, from business development and marketing 
executives to pure researchers, engineers, and scientists. Based on om experience, we have identified a 
number of best practices that produce the most useful results. These include: 

• Involve a diverse team of people and perspectives in the effort. 

• Put a stake in the ground aroimd what senior management or key decision-makers consider vital 
aspects of the company's strategic intent; if the company has a clear vision or sense of what it wants 
to be, then take it into accoimt. 

• Maintain openness about the uncertainty of customer needs and wants. 

• Incorporate a strong technology road-mapping capability in order to make the pathway from big ideas 
to the creation of actual products and services clear. 

• Establish a well-functioning connection between R&D, marketing, and manufacturing departments. 

• Embed a continuous learning loop and focused scenario analysis at the market entry- point and 
beyond. 

Using Scenario Analysis to Guide R&D Planning 



The purpose of R&D is to enhance the product and service offerings of a company. This may mean 
incremental or revolutionary improvements to current products or the introduction of completely new , 
offerings. However, in a successful business, R&D is not solely the job of the technical people who sit in 
the laboratory, invent things, and throw them over the wall. Good R&D requires a connection to customer 
needs and desires and to how products and services might be priced, positioned, and sold relative to the 
competition. This is a complex process involving many people with different roles and priorities, which 
inevitably gives rise to communication challenges. 

It is in managing such communication challenges that scenario analysis techniques can provide real value. 
A diverse team of people, drawn from across the organization and seeded with knowledgeable outsiders 
(maybe even customers), can open up the strategic conversation about the intent and direction of R&D 
spending. In other words, it is useful to bring together key stakeholders from marketing, customer 
relations, business development, and finance as well as R&D to ask a broader set of questions: What is 
our R&D spending trying to achieve? Over what timeframe? What will enhance our competitiveness? 
How will R&D help meet important aspects of the customer's total value proposition? These questions 
cannot be answered by the R&D department's technical staff alone. A well-managed scenario analysis 
provides a process through which diverse stakeholders can explore the uncertainties behind these 
questions in an open and learning-oriented way. Ultimately, it can generate exciting new insights, deepen 
the shared understanding of R&D decision-making, and build lasting, cross-organizational relationships. 
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A Common R&D Scenario Framework 



To explain more about scenario analysis in R&D, it is useful to share a scenario framework that arose 
consistently in our R&D work. Of course, how these scenarios unfold — and their ultimate implications for 
R&D — varied widely depending on the company or industry. 

In developing scenarios, it is useful to establish the framework by isolating two highly uncertain but very 
important variables that may drive change in the future. In our R&D work, we found two recurring 
variables: (1) the pace or direction of technology innovation, and (2) changes in customer needs or wants. 
In most cases, the scenario teams felt that the underlying technology or technologies they were working 
with could either accelerate or stagnate, be open to sudden breakthroughs, be shifted by wildcards, or be 
largely out of their control. Despite edicts to "know thy customer," the teams felt that customer demand 
could be fickle — outside factors such as competitive offerings, substitute products, economic conditions, 
and peer pressure often changed the shape of that demand. This realization typically led to variations of 
the scenario framework displayed below. 



Revolutionary/Accelerating 



Ideas Frustrated 
with Markets 



Slow 



Brave New World 



Fast 



Common 



Changing Customer o 



Needs and Wants 



Divergent 



Same as Today 



World of Frustration 



Evolutionary /Moderating 



This framework was only a starting point for detailed and well-researched scenarios. Its strength lays in 
the truly divergent and challenging worlds that each quadrant suggests. Typically, the northeast quadrant 
produced a "Brave New World" scenario, where many big changes — and opportunities — challenged 
companies to keep up and iimovate. The southwest quadrant, by contrast, tended to produce scenarios 
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with a "Same as Today" feeling; participants were either satisfied that their companies were well 
positioned or frustrated that a lot of good ideas would go undeveloped. Scenarios for the southeast and 
northwest quadrants at first seemed counterintuitive, and the teams found that making them "work" in the 
real world was both challenging and exciting. The southeast quadrant typically involved a "World of 
Frustration" — a world in which customer needs went unmet and a series of inadequate solutions were 
attempted and usually failed. In the northwest quadrant, the scenario was often a variation on "Ideas 
Frustrated with Markets." Participants worried that new technologies would not match customer needs 
and wants and therefore would not find profitable markets. In many cases, the southeast and northwest 
quadrants introduced unexpected, but plausible, real-world contradictions into the conversation. 

Elements of a Good Scenario Analysis 



Whether scenarios are developed to guide R&D plans or to inform other strategic decisions, some basic 
steps should be followed. Once divergent, well-researched, and compelling scenarios are created, they 
should be used to test or "windtunnel" existing strategies — what the organization is actually doing or 
positioning itself to do in the areas of concern. Secondly, the scenarios should be used to create new 
strategic options. In order to do this, members of the stakeholder team should "live" in each scenario (i.e., 
assume it is true) and determine what strategies or actions might lead to success. Then the options for 
each scenario should be tested for robustness. Those that are robust should become high priority. Those 
that are not, but have great appeal if certain events unfold, should be looked at closely in two ways. First, 
are there low-cost and low-risk actions we can take that will allow the organization to quickly move to 
this option? Second, can we identify and scan for early indicators that give us a signal to move that option 
to the forefront? Making strategy development proactive rather than reactive and dynamic instead of 
static is among the most valuable dimensions of scenario analysis. 

Getting the Most from R&D Scenarios 



In our experience, a strong, well-facilitated team will create challenging and useful scenarios. The real 
differences lie in the level of participation, and in how the scenarios are ultimately used and shared within 
in the organization, as demonstrated by the following three examples. 

In one of our most successful cases in the telecommunications industry, a joint team from business 
development and R&D initially requested the scenarios. This team worked together throughout the 
process and, at a key point, introduced and "windtunneled" a technology roadmap through the scenarios. 
The conversation exploded with insights and ideas. Team members were able to pinpoint specific 
technical advances that would support high value-added or competitive product features specific to each 
scenario. The path to commercializing products was also made clearer and more concrete. Importantly, 
the team enjoyed clear support and direction from senior management. Management told the team that 
there were no "failures," and that if a chosen path did not succeed in meeting its objectives there was still 
an opportunity to capture the learning for future efforts. The five-year timeframe for evaluating results 
allowed them to be patient, and the scenarios provided the context for deeper, more focused analysis. 
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Years after we concluded the project, focused scenarios were being used to consider pathways to market 
entry. 

In a moderately successful effort, a company involved in heavy manufacturing succeeded not so much in 
radically shifting the direction of its R&D spending, but in getting a wide range of parties involved. As a 
result, the ultimate decisions were well understood and supported across the organization, and 
relationships were built internationally across several groups. Finally, the team isolated some key 
uncertainties for longer-term scanning and monitoring that could portend a change in direction. The 
project could have been much more valuable if there had been deeper research on and openness toward 
changing customer needs and wants. Integrating more customer perspectives would also have added 
more content in the strategic option development stage of the project. 

Our least successful effort involved a consortixmi of companies, and featured a general confusion and lack 
of cohesion around the strategic intent of the key stakeholders. These companies were mostly involved in 
computers and information technology and fit in different places along the value chains of those 
industries. In this situation, R&D results had to be shared with multiple and sometimes competing frnns. 
Competitive concerns kept many participants from being explicit about their true strategic interests and 
made it impossible to test existing or potential strategies within the context of the scenarios. Eventually 
this handicapped the lead organization's ability to articulate viable options and share the results. 
However, the project did have a powerful impact in terms of using the scenario development process as a 
tool for sharing perspectives across a very diverse group. Many participants expressed appreciation at the 
opportunity to see how an issue or problem might be seen very differentiy by companies at different 
points in the industry value chain. 

Based on these and similar projects, we recommend following the process map in order to ensure that 
scenario analysis is successfully applied to R&D planning: 
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Conclusion 



Scenario analysis can enhance and guide R&D efforts by engaging a broader range of 
stakeholders, leveraging their experience and knowledge to create divergent and challenging 
future worlds that illuminate risks and opportunities, and creating a context for evaluating 
existing and potential strategies in an uncertain world. Ultimately, scenario analysis can enrich 
an organization's ongoing strategic conversation about the purpose and increasing importance of 
forward-looking research, development, and innovation. 
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Fast detection of communication patterns in distributed executions | 
Thomas Kunz, Michiel F. H. Seuren 

November 1997 Proceedings of the 1997 conference of the Centre for Advanced Studies 
on Collaborative research 

Full text available: '^.pd^fi^g.l^lBJ Additional Infornnation: fyllcitatipn, abstract, references, jndex ternns 

Understanding distributed applications is a tedious and difficult task. Visualizations based on 
process-tinne diagrams are often used to obtain a better understanding of the execution of 
the application. The visualization tool we use is Poet, an event tracer developed at the 
University of Waterloo. However, these diagrams are often very complex and do not provide 
the user with the desired overview of the application. In our experience, such tools display 
repeated occurrences of non-trivial commun ... 
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15 Issue 6 
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Change is pervasive during software development, affecting objects, processes, and 
environments. In process centered environments, change management can be facilitated by 
software-process programming, which formalizes the representation of software products 
and processes using software-process programming languages (SPPLs). To fully realize this 
goal SPPLs should include constructs that specifically address the problems of change 
management. These problems include lack of representation of ... 

^ Pr@dictabi[ity..re^ | 
Michael B. Jones, Stefan Saroiu 

June 2001 ACM SIGMETRICS Performance Evaluation Review , Proceedings of the 
2001 ACM SIGMETRICS international conference on Measurement and 
modeling of computer systems, volume 29 issue i 

Full text available: '^ pdf(1.53 MB) Additional Information: full citation, abstract, references , citinos 

Soft Modems use the main processor to execute modem functions traditionally performed 
by hardware on the modem card. To function correctly, soft modems require that ongoing 
signal processing computations be performed on the host CPU in a timely manner. Thus, 
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signal processing is a commonly occurring background real-time application— one running 
on systems that were not designed to support predictable real-time execution. This paper 
presents a detailed study of the performance characteris ... 

Keywords: CPU scheduling, Rialto, Rialto/NT, Windows 2000, Windows NT, open real-time 
system, real-time, signal processing, soft devices, soft modem 
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Requirements interaction management 

William N. Robinson, Suzanne D. Pawlowski, Vecheslav Volkov 

June 2003 ACM Computing Surveys (CSUR), Volume 35 issue 2 

Full text available: '^pjfQ:24 MB.i Additional Infornnatlon: MLcltatjon, abstract, .reference^, indexjerms 

Requirements interaction management (RIM) is the set of activities directed toward the 
discovery, management, and disposition of critical relationships among sets of 
requirements, which has become a critical area of requirements engineering. This survey 
looks at the evolution of supporting concepts and their related literature, presents an 
issues-based framework for reviewing processes and products, and applies the framework 
in a review of RIM state-of-the-art. Finally, it presents seven researc ... 

Keywords: KAOS, KATE, Oz, Requirements engineering, Telos, WinWin, analysis and 
design, composite system, deficiency driven design, dependency analysis, distributed 
intentionality, interaction analysis, software cost reduction (SCR)., system architecture, 
system specification, viewpoints 
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Full text available- ;>df(235 jViB) Additional Information: full citation , abstract , references, citings, index 
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In this paper, we study hierarchical resource management models and algorithms that 
support both link-sharing and guaranteed real-time services with decoupled delay (priority) 
and bandwidth allocation. We extend the service curve based QoS model, which defines 
both delay and bandwidth requirements of a class, to include fairness, which is important 
for the integration of real-time and hierarchical link-sharing services. The resulting Fa/r 
Service Curve link-sharing model formalizes the go ... 
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Robert Wilensky, David N. Chin, Marc Luria, James Martin, James Mayfield, Dekai Wu 
December 1988 Computational Linguistics, Volume 14 Issue 4 
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UC (UNIX Consultant) is an intelligent, natural language interface that allows naive users to 
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learn about the UNIX^ operating system. UC was undertaken because the task was thought 
to be both a fertile donnain for artificial intelligence (AI) research and a useful application of 
AI work in planning, reasoning, natural language processing, and knowledge 
representation.The current implennentatlon of UC comprises the following components: a 
language analyzer, called ALANA, produces a repre ... 

^ DperMing.syMemsior„sens^^^ 

Chih-Chieh Han, Ram Kumar, Roy Shea, Eddie Kohler, Mani Srivastava 
June 2005 Proceedings of the 3rd international conference on Mobile systems, 
applications, and services 

Full text available: ^pdf(418.Q7 KB) Additional Information: full citation, abstrgict . references 

Sensor network nodes exhibit characteristics of both embedded systems and general- 
purpose systems. They must use little energy and be robust to environmental conditions, 
while also providing common services that make it easy to write applications. In TinyOS, 
the current state of the art in sensor node operating systems, reusable components 
implement common services, but each node runs a single statically-linked system image, 
making it hard to run multiple applications or incrementally update app ... 
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Peng Ning, Yun Cui, Douglas S. Reeves, Dingbang Xu 

May 2004 ACM Transactions on Information and System Security (TISSEC), volume 7 

Issue 2 

Full text available: ■^|>df(155.MBi Additional Infornnation: MLcMtlon, sbstract, reMenQes, indexleriTis 

Traditional intrusion detection systems (IDSs) focus on low-level attacks or anomalies, and 
raise alerts independently, though there may be logical connections between them. In 
situations where there are intensive attacks, not only will actual alerts be mixed with false 
alerts, but the amount of alerts will also become unmanageable. As a result, it is difficult for 
human users or intrusion response systems to understand the alerts and take appropriate 
actions. This paper presents a sequence oft ... 

Keywords: Intrusion detection, alert correlation, security management 
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May 2003 Proceedings of the 25th International Conference on Software Engineering 

Full text available: ^ (gjl 
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Many methods and tools for the reenglneering of software systems have been developed so 
far. However, the domain-specific requirements of telecommunication systems have not 
been addressed sufficiently. These system are designed in a process- rather than in a data- 
centered way. Furthermore, analyzing and visualizing dynamic behavior is a key to system 
understanding. In this paper, we report on tools for the reenglneering of telecommunication 
systems which we have developed in close cooperation wl ... 
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Software process programming is the coding of software processes in executable 
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programming languages. Process programming offers many potential benefits, but tlieir 
realization has been hampered by a lack of experience in the design and use of process 
programming languages. APPL/A is a prototype software process programming language 
developed to help gain this experience. It is intended for the coding of programs to 
represent and support software processes Including process, product, and p ... 

Keywords: consistency management, multlparadigm programming languages, software 
process programming, transaction management 
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engineering applications of artificial intelligence and expert systems - 

Volume 1 

Full text available: ' ^pdf(856.29 KB) Additional Information: t'uil citation, abstract, references, index terms 

This paper describes the development of an automated flight test management system 
(ATMS) as a component of a rapid-prototyping flight research facility for Al-based flight 
systems concepts. The ATMS provides a flight test engineer (FTE) with a set of tools that 
assist in flight test planning, monitoring and simulation. This system is also capable of 
controlling an aircraft during flight test by performing closed-loop guidance functions, range 
management, and maneuver-quality monitoring. Th ... 
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terms 



The existence of statically detectable correlation among conditional branches enables their 
elimination, an optimization that has a number of benefits. This paper presents techniques 
to determine whether an interprocedural execution path leading to a conditional branch 
exists along which the branch outcome Is l<nown at compile time, and then to eliminate the 
branch along this path through code restructuring. The technique consists of a demand 
driven interprocedural analysis that determines whethe ... 

DCWPL: a programming language for describing collaborative work 
Mauricio Cortes, Prateek Mishra 

November 1996 Proceedings of the 1996 ACM conference on Computer supported 
cooperative work 

Full text available: "P ^ ^xif(1.12 ME-j) Additional Information: full citation, references, citings, index terms 
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Timing analysis: Multiple process execution in cache related preemption delay analysis 
Jan Staschulat, Rolf Ernst 

September 2004 Proceedings of the fourth ACM international conference on Embedded 
software 

Full text available: Wi Ddft241.51 KB) Additional Information: full citation, abstract, references, index terms 



Cache prediction for preemptive scheduling is an open issue despite its practical 
importance. First analysis approaches use simplified models for cache behavior or they 
assume simplified preemption and execution scenarios that seriously impact analysis 
precision. We present an analysis approach which considers multiple executions of 
processes and preemption scenarios for static priority periodic scheduling. The results of 
our experiments show that caches introduce a strong and complex timing dep ... 

Keywords: cache, embedded systems, scheduling, worst case execution time analysis 
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The Workshop on "Domain Analysis in the DoD," sponsored by the Software Reuse Initiative 
(SRI) and Defense Information Systems Agency (DISA), was held at MITRE Corporation, in 
McLean, Virginia on 26 - 27 September 1995. The primary purpose of the workshop was to 
discuss issues related to identifying and scoping domains with emphasis on product lines 
and to assess the usefulness of the strawman SRI Domain Scoping Framework as a 
proposed basis for this scoping activity. To this end, two specific 0 ... 
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In computer design, it is essential to know the effectiveness of different design options in . 
improving performance and dependability. Various software tools have been created to 
evaluate these parameters, applying both analytic and simulation techniques, and this 
paper reviews those related primarily to reliability, availability, and serviceability. The 
purpose, type of models used, type of systems modeled, inputs, and outputs are given for 
each package. Examples of some of the key modeling ... 
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Organisations today perceive information technology systems as vital to their success. The 
effective application of information from an organisational perspective can mean the 
difference between success or failure. The ORDIT (organisational requirements definition for 
information technology) approach was developed as a socio-technical systems based 
methodology, its purpose is to facilitate problem solvers and problem owners in developing 
the correct understanding of what is required, why it is r ... 
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